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DETAILED ACTION 
Response to Arguments 

Applicant's arguments with respect to claims have been considered but 
are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described 
as set forth in section 1 02 of this title, if the differences between the subject matter sought to 
be patented and the prior art are such that the subject matter as a whole would have been 
obvious at the time the invention was made to a person having ordinary skill in the art to which 
said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

Claims 1, 3-10, 12-20, 47-57, 68-90, and 94-97 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Patent 6,173,317 to Chaddha in view 
of U.S. Patent 6,128,653 to del Val. 

Regarding claims 1 , 9, Chaddha discloses in figures 9 and 10A, a device 
240 which receives both a video stream and an annotation stream associated 
with the video, a video images is displayed on a display device and associated 
web content is retrieved for display with the video (column 7, line 15-column 9, 
line 30), VCR like control buttons 620 and a table of contents window 630, which 
are selectable and change the display of the video and associated content 
(column 6, lines 22-34). Chaddha does not disclose and interactive command 
function specified by the associated data stream. Del Val discloses utilizing 
HTTP protocol for streaming digital media, a user's browser, or browser plugin 
utilizes HTTP to send play, stop, rewind, fast-forward and pause commands to 
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the web server/video server (Figure 5, column 8, line 64-column 9, line 60). 
Therefore, it would have been obvious to one skilled in the art at the time of 
invention to modify Chaddha to utilize HTTP commands to control a data stream 
as taught by del Val and enable the transmission of video across a firewall. 

Regarding claim 3, Chaddha discloses that the video and annotation 
streams may be retrieved via the internet (column 8, lines 46-59). Chaddha 
inherently utilizes a packet identifier to indicate that data type of a packet, 
otherwise the computer 240 would not know which packets are to be decoded by 
video decoder 964 and which are to be processed by the browser. 

Regarding claims 4-7, Chaddha discloses in Figure 6, a browser window 
600, with video window 610, and supplementary content windows 630/640, a 
designer utilizes HTML to create a display screen for a user and specifies the 
location of each element on the screen (column 6, lines 22-34). 

Regarding claim 8, Chaddha discloses the use of VCR like control buttons 
620 and a table of contents window 630, which are selectable and change the 
display of the video and associated content (column 6, lines 22-34). 

Regarding claim 10, Chaddha discloses the use of an audio time track 770 
synchronized with the video, and that audio is decoded by decoder 964 (column 
6, line 52-column 7, line 59). 

Regarding claims 12-15, 17-18, 94-97 Chaddha discloses in Figure 6, a 
browser window 600, with video window 610, and supplementary content 
windows 630/640, a designer utilizes HTML to create a display screen for a user 
and specifies the location of each element on the screen (column 6, lines 22-34), 
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VCR like control buttons 620 and a table of contents window 630, which are 
selectable and change the display of the video and associated content (column 
6, lines 22-34). Chaddha inherently specifies a color palate, location of objects on 
the screen, coordinate scale, background color, text and text attributes as 
Chaddha utilizes HTML to create the display screen. 

Regarding claim 16, Chaddha discloses that a user may use a keyboard 
or a pointing device to interact with the video/annotation data (column 4, lines 59- 
65). Chaddha/del Val does not disclose specifying a selection device. The 
examiner takes official notice that specifying a computer peripheral for interacting 
with a program is well known in the art, for example, specifying a mouse to 
interact with a window or a joystick to play a game. Therefore, it would have been 
obvious to one skilled in the art at the time of invention to modify Chaddha and 
del Val to specify a device to interact with a selection onscreen in order to 
provide a familiar user interface. 

Regarding claim 19, Chaddha discloses that the video and annotation 
streams may be retrieved via the internet (column 8, lines 46-59). Chaddha 
inherently filters the data by destination address as it retrieves the video and html 
information from the internet and utilizes HTML get requests (column 5, line 10- 
column 6, line 34, column 8, lines 31-64), and the content must be directed to the 
proper location within the computer in order to be decoded and processed. 

Regarding claim 20, Chaddha discloses that the video and annotation 
streams may be retrieved via the internet (column 8, lines 46-59). Chaddha 
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inherently filters the data by source address as it uses URLs to locate the 
video/supplementary content streams (column 7, line 15-column 8, line 59). 

Regarding claims 72-89, Chaddha discloses in figures 9 and 10A, a 
computer 240 which receives both a video stream and an annotation stream 
associated with the video, a video images is displayed on a display device 104 
and associated web content is retrieved for display with the audio/video, the data 
is resembled and decoded by decoder 964 and Tenderer 965 (column 7, line 15- 
column 9, line 30), VCR like control buttons 620 and a table of contents window 
630, which are selectable and change the display of the video and associated 
content (column 6, lines 22-34), a producer utilizes a workstation and HTML to 
create a Livescreen display for viewing at the user's computer (column 6, lines 
22-34), a POTS modem, ISDN or Ethernet may connect a client computer 240 to 
a server 220 (column 6, line1-5), additionally Chaddha discloses that 
microprocessor 116 controls the computer 100 and controls the reception and 
manipulation of input data and supplies the data to be output on display devices 
(column 4, lines10-32). Chaddha inherently specifies a color palate, location of 
objects on the screen, text and text attributes as Chaddha utilizes HTML to 
create the display screen. Chaddha does not disclose and interactive command 
function specified by the associated data stream. Del Val discloses utilizing 
HTTP protocol for streaming digital media, a user's browser, or browser plugin 
utilizes HTTP to send play, stop, rewind, fast-forward and pause commands to 
the web server/video server (Figure 5, column 8, line 64-column 9, line 60). 
Therefore, it would have been obvious to one skilled in the art at the time of 
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invention to modify Chaddha to utilize HTTP commands to control a data stream 
as taught by del Val and enable the transmission of video across a firewall. 

Regarding claim 90, Chaddha discloses in figures 9 and 10A, a computer 
240 which receives both a video stream and an annotation stream associated 
with the video, a video images is displayed on a display device 104 and 
associated web content is retrieved for display with the audio/video, the data is 
resembled and decoded by decoder 964 and renderer 965 (column 7, line 15- 
column 9, line 30), VCR like control buttons 620 and a table of contents window 
630, which are selectable and change the display of the video and associated 
content (column 6, lines 22-34), a producer utilizes a workstation and HTML to 
create a Livescreen display for viewing at the user's computer (column 6, lines 
22-34), a POTS modem, ISDN or Ethernet may connect a client computer 240 to 
a server 220 (column 6, line1-5), additionally Chaddha discloses that 
microprocessor 1 16 controls the computer 100 and controls the reception and 
manipulation of input data and supplies the data to be output on display devices 
(column 4, lines10-32). Chaddha inherently scales the video window 610 as 
Chaddha utilizes HTML. 

Regarding claim 98, Chaddha discloses in Figure 6, a browser window 
600, with video window 610, and supplementary content windows 630/640, a 
designer utilizes HTML to create a display screen for a user and specifies the 
location of each element on the screen (column 6, lines 22-34), VCR like control 
buttons 620 and a table of contents window 630, which are selectable and 
change the display of the video and associated content (column 6, lines 22-34). 
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Chaddha and del Val do not disclose the use of a text background transparency 
attribute. The examiner takes official notice that the use of an HTML 
transparency attribute is well known in the art. Therefore, it would have been 
obvious to one skilled in the art at the time of invention to modify Chaddha and 
del Val to include an HTML transparency attribute in order to better organize a 
combination HTML video display. 

Claims 2, 11 , 47,48, 51-54, 62-71 and 91-93 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Patent 6,173,317 to Chaddha in view of U.S. 
Patent 5,991,799 to Yen. 

Regarding claims 2, 1 1 , 62, 65, 66, Chaddha discloses in figures 9 and 
10A, a device 240 which receives both a video stream and an annotation stream 
associated with the video, a video images is displayed on a display device 104 
and associated web content is retrieved for display with the audio/video, the data 
is resembled and decoded by decoder 964 and renderer 965 (column 7, line 15- 
column 9, line 30), VCR like control buttons 620 and a table of contents window 
630, which are selectable and change, the display of the video and associated 
content (column 6, lines 22-34), a producer utilizes a workstation and HTML to 
create a Livescreen display for viewing at the user's computer (column 6, lines 
22-34), a POTS modem, ISDN or Ethernet may connect a client computer 240 to 
a server 220 (column 6, line1-5). Chaddha does not disclose a video stream 
coded in video scan intervals and the data stream being coded in the non-video 
scan intervals of the video signal. Yen discloses a video system, in which 
supplementary content is transmitted in the vertical blanking interval of broadcast 
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video or in MPEG 2 video (column 4, line 34-column 5, line 53). Therefore it 
would have been obvious to one skilled in the art at the time of invention to 
modify Chaddha to transmit additional information within the VBI in order to 
provide supplementary content to a user without internet access. 

Regarding claims 47,48, 51, and 68-71, Chaddha discloses in figures 9 
and 10A, a computer 240 which receives both a video stream and an annotation 
stream associated with the video, a video images is displayed on a display 
device 104 and associated web content is retrieved for display with the 
audio/video, the data is resembled and decoded by decoder 964 and renderer 
965 (column 7, line 15-column 9, line 30), VCR like control buttons 620 and a 
table of contents window 630, which are selectable and change the display of the 
video and associated content (column 6, lines 22-34), a producer utilizes a 
workstation and HTML to create a Livescreen display for viewing at the user's 
computer (column 6, lines 22-34), a POTS modem, ISDN or Ethernet may 
connect a client computer 240 to a server 220 (column 6, line1-5), additionally 
Chaddha discloses that microprocessor 116 controls the computer 100 and 
controls the reception and manipulation of input data and supplies the data to be 
output on display devices (column 4, lines 10-32). Chaddha does not disclose 
data packets specifying a graphical command or a video stream coded in video 
scan intervals and the data stream being coded in the non-video scan intervals of 
the video signal. Del Val discloses utilizing HTTP protocol for streaming digital 
media, a user's browser, or browser plugin utilizes HTTP to send play, stop, 
rewind, fast-forward and pause commands to the web server/video server 
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(Figure 5, column 8, line 64-column 9, line 60). Yen discloses a video system, in 
which supplementary content is transmitted in the vertical blanking interval of 
broadcast video or in MPEG 2 video (column 4, line 34-column 5, line 53). 
Therefore, it would have been obvious to one skilled in the art at the time of 
invention to modify Chaddha to utilize HTTP commands to control a data stream 
as taught by del Val and enable the transmission of video across a firewall and to 
transmit additional information within the VBI/MPEG stream as taught by Yen in 
order to provide supplementary content to a user without internet access. 

Regarding claims 52-54, Chaddha discloses that both the 
audio/video/annotation streams are synchronized (column 7, line 15-column 9, 
line 30) and that graphics are displayed on a monitor 104 (column 3, line 64- 
column 4, line 10, column 8, lines 3-13) and a video/audio decoder and renderer 
965 are used to process the video/audio, in figures 9 and 10A, Chaddha shows a 
computer 240 which receives both a video stream and an annotation stream 
associated with the video, a video images is displayed on a display device 104 
and associated web content is retrieved for display with the audio/video, the data 
is resembled and decoded by decoder 964 and Tenderer 965 (column 7, line 15- 
column 9, line 30), VCR like control buttons 620 and a table of contents window 
630, which are selectable and change the display of the video and associated 
content (column 6, lines 22-34), a producer utilizes a workstation and HTML to 
create a Livescreen display for viewing at the user's computer (column 6, lines 
22-34), a POTS modem, ISDN or Ethernet may connect a client computer 240 to 
a server 220 (column 6, line1-5), additionally Chaddha discloses that 
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microprocessor 116 controls the computer 100 and controls the reception and 
manipulation of input data and supplies the data to be output on display devices 
(column 4, lines 10-32). 

Regarding claim 63, Chaddha discloses that the video and annotation 
streams may be retrieved via the internet (column 8, lines 46-59). Chaddha 
inherently filters the data by source address as it uses URLs to locate the 
video/supplementary content streams (column 7, line 15-column 8, line 59). 

Regarding claim 64, Chaddha discloses that the video and annotation 
streams may be retrieved via the internet (column 8, lines 46-59). Chaddha 
inherently filters the data by destination address as it retrieves the video and html 
information from the internet and utilizes HTML get requests (column 5, line 10- 
column 6, line 34, column 8, lines 31-64), and the content must be directed to the 
proper location within the computer in order to be decoded and processed. 

Regarding claim 67, Chaddha discloses that the video and annotation 
streams may be retrieved via the internet (column 8, lines 46-59). Chaddha 
inherently filters the data by source address as it uses URLs to locate the 
video/supplementary content streams (column 7, line 15-column 8, line 59). 
Chaddha inherently filters the data by destination address as it retrieves the 
video and html information from the internet and utilizes HTML get requests 
(column 5, line 10-column 6, line 34, column 8, lines 31-64), and the content 
must be directed to the proper location within the computer in order to be 
decoded and processed. 
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Regarding claims 91-93, Chaddha discloses in figures 9 and 10A, a 
device 240 which receives both a video stream and an annotation stream 
associated with the video, a video images is displayed on a display device 104 
and associated web content is retrieved for display with the audio/video, the data 
is resembled and decoded by decoder 964 and Tenderer 965 (column 7, line 15- 
column 9, line 30), VCR like control buttons 620 and a table of contents window 
630, which are selectable and change the display of the video and associated 
content (column 6, lines 22-34), a producer utilizes a workstation and HTML to 
create a Livescreen display for viewing at the user's computer (column 6, lines 
22-34), a POTS modem, ISDN or Ethernet may connect a client computer 240 to 
a server 220 (column 6, line1-5). Yen discloses a video system, in which 
supplementary content is transmitted in the vertical blanking interval of broadcast 
video or in MPEG 2 video (column 4, line 34-column 5, line 53). Chaddha and 
Yen do not disclose the use of a modem coupled to a cable, satellite, or 
broadcast transmitter. The examiner takes official notice that the use of a modem 
coupled to a transmitter for inserting VBI data is well known in the art. Therefore 
it would have been obvious to one skilled in the art at the time of invention to 
modify Chaddha/Yen to transmit additional information within the VBI in order to 
provide supplementary content to a user without internet access, by coupling a 
modem to a transmitter. 

Claims 58-61 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Patent 6, 1 73,31 7 to Chaddha in view of U.S. Patent 5,991 ,799 to Yen, U.S. 
Patent 6,128,653 to del Val and U.S. Patent 5,512,935 to Majeti. 
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Regarding claims 58, 60, and 61 Chaddha discloses in figures 9 and 10A, 
a device 240 which receives both a video stream and an annotation stream 
associated with the video, a video images is displayed on a display device 104 
and associated web content is retrieved for display with the audio/video, the data 
is resembied and decoded by decoder 964 and Tenderer 965 (column 7, line 15- 
column 9, line 30), VCR like control buttons 620 and a table of contents window 
630, which are selectable and change the display of the video and associated 
content (column 6, lines 22-34), a producer utilizes a workstation and HTML to 
create a Livescreen display for viewing at the user's computer (column 6, lines 
22-34), a POTS modem, ISDN or Ethernet may connect a client computer 240 to 
a server 220 (column 6, line1-5). Chaddha/Yen/del Val does not disclose a 
computer coupled to the receiver. Majeti discloses in Figure 1, consumer premise 
equipment 20, in which pc 74 is coupled to STB 62 and CATV headend 30N. 
Therefore, it would have been obvious to one skilled in the art at the time of 
invention to modify Chaddha, Yen and del Val to couple it to the receiver as 
taught by Majeti thus providing a high speed downlink to both devices for rapid 
delivery of content. 

Regarding claim 59, Chaddha discloses a device 240, which receives 
audio/video and associated content from a server 220. Chaddha/Majeti do not 
disclose the use of a satellite receiver. The examiner takes official notice that use 
of a satellite receiver for receiving video and internet content is well known in the 
art, for example DBS satellite services. Therefore it would have been obvious to 
one skilled in the art at the time of invention to modify Chaddha/Majeti to utilize a 
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satellite receiver in order to make use of its large downstream bandwidth in areas 
in which CATV service is not provided. 



Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Hunter B. Lonsberry whose telephone 
number is 703-305-3234. The examiner can normally be reached on Monday- 
Friday during normal business hours. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Andrew Faile can be reached on 703-305-4380. The fax 
phone number for the organization where this application or proceeding is 
assigned is 703-308-5359. 

Any inquiry of a general nature or relating to the status of this application 
or proceeding should be directed to the receptionist whose telephone number is 
703-305-4700. 
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